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Abstract 

Introduction. The article studies the problem of validating the specified levels of reliability during experimental 
development of a complex technical series system. Such tasks arise when it is required to make a decision on testing the 
system as part of a larger one or on the completion of experimental development and the start of series production. The 
study is aimed at validating the reduction of the experimental development time. The task is to determine whether the 
hypothesis H, is accepted or rejected. 

Materials and Methods. To implement the research objective and task, a critical area described by the inequality was 
constructed based on the test results. The formulation of the requirements validation task was based on well-known 
approaches to testing statistical hypotheses. The conceptual apparatus of information theory, probability, and statistics 
was involved. The theoretical and applied literature on mathematical methods in reliability theory was studied. The 
particular tasks of the work were solved by known ways. Thus, the probability of obtaining the exact number of 
successful outcomes in a certain number of experiments was determined by the Bernoulli scheme. The exact confidence 
interval based on the binomial distribution was derived from the Clopper-Pearson relation. The theorem of 
A.D. Solovyov and R. A. Mirny made it possible to assess the system reliability based on the test results of its 
components. 

Results. Control rules adequate to the stage of experimental development (with insufficient data on the technical 
system) and the stage of series production were mathematically defined. The probability of a successful outcome when 
testing technical systems was represented by: 

— the probability of event for a system element; 

— confidence value; 

— required scope of tests 

In these terms, the null and alternative hypotheses and the corresponding reliability control procedures were 


investigated. Two provisions were considered. The first one provided using the null confidence 


hypothesis H, = {P 2 ae and an alternative H = ip < Pt to confirm the requirements (P,, y) for the reliability 
indicator of one parameter for any (P,, y). In this case, one trouble-free test was enough. The second provision 


considered a sequential technical system with independent elements that were tested separately from the system 
according to the Bernoulli scheme for one parameter. We considered the requirements for the system in the form of a 


set of values (P,, y) and the requirements for any of its elements (P,,;, y) . They coincided when the planned outcome 
of the tests corresponded to the cases when the ratio P= lim:P,=P,, was fulfilled, and the null alternative 


lsis<N 


hypothesis was selected from the theory of statistical hypothesis testing. 
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Discussion and Conclusions. The experimental development strategy should be implemented in two stages: the search 
and validation of the reliability of the elements through a series of fail-safe tests. In this case, the planned scope of tests 
of each element is determined taking into account the confidence probability, the lower limit of the confidence interval, 
and the requirements for reliability indices of one parameter of the technical system. If the use of the null confidence 


hypothesis is acceptable, one fail-safe test is sufficient to confirm the requirements for the reliability index. 


Keywords: experimental development, testing of statistical hypotheses, reliability of a technical system, null 
hypothesis, alternative hypothesis, hypothesis of distrust, confidence hypothesis, confidence probability, scope of fail- 
safe tests, binomial type test model, Bernoulli scheme, Clopper-Pearson equation, theorem of A. D. Solovyov and 
R. A. Mirny. 
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AHHOTalna 

Beedenue. Cratbs llocBaljena npoOseme NOATBepxKAeCHHA 3a aHHbIX ypoBHel HajexKHOCTH IIpH 9KCIepHMeHTaIbHO 
oTpaOoTKe cyIO%KHOW TeXHWYeCKOH CHCTeMbI C MOCIIeCAOBaTeIbHbIM COeMHeHHeM 9JIeMeHToB. Takue 3aauH 
BO3HHKAIOT, KOI a TpeOyeTca IPHHATb pellieHve OO MCIIbITAHHM CHCTeMBI B COCTaBe Oolee KpyMHO HIM OO OKOHYAHHU 
3KCHepHMeHTaIbHOH OTpaOoTKH U 3allycKe cepHiiHoro mpon3BoycTBa. Lenb uccneqoBaHua — OO0CHOBaTb 
cokpallleHHe CpOKOB 93KCIIepHMecHTaIbHOM oTpaboTKH. 3aqaya — ompeyeuIMTb, IPWHUMaeTCA WIM OTKIOHAeTCA 
runote3a H,. 

Mamepuaaoi u memoooi. Jina peamm3aiuu Wen u 3ayauu padoTsl 10 pesyibTaTaM MCIbITAaHHM CTpOMTCA KpuTHYecKaA 
oOslacTb, ONMChIBaeMad HepaBeHCTBOM. WopMyMpoBKa 3aa4uu MOATBepKTeHHA TpeOoBaHui Oa3upyeTca Ha 
V3BeECTHBIX TOAxoqaxX K MpoBepke cTaTHcTWY4ecKHxX YTuMoTe3. 3afeiicTByeTca MOHATHMHEIM allapat Teopun 
WHopMallMu, BepoaxTHOCTU u cTaTucTuKH. M3y4eHa TeopeTuyeckad MU MIpHKaqHad WMTepaTypa O MaTeMaTH4eCKHX 
MeToyax B Teopuu HaylexHocTu. UacTHple 3afa4u paOoThI pellieHbI W3BeCTHBIMH ciiocoOamu. Tak, BepOATHOCTb 
MOJYYeHHA TOUHOTO YMCA YCIeLWIHbIX HCXOJOB B ONpeesIeCHHOM KOJIM4eCTBE IKCIeEPHMeHTOB OlipeyeseHa MO CxeMe 
Bepuymu. TouHbiii OBepHTeIbHbIM WHTepBasl, OCHOBaHHbIM Ha OMHOMMaJIbBHOM pacripeyeeHuu, WomryyeH v3 
cooTHomeHua Knonmepa — IIupcona. Teopema A. JI. Conospesa u P. A. MupHoro no3BouIMsIa OLCHHTb HajlexKHOCTb 
CHCTeMBI 10 pe3yJIbTaTaM MCIIbITAaHHN ee KOMIMOHEHT. 

Pezyivmamvl ucciedoeanua. MaremaTuyeckw ofipesesieHbl mpaBvsia KOHTpOJIA, afleKBaTHbIe 9TAarly 
3KCHePHMeHTAaIbHOM OTpaOOTKH (pH HeOcTaTOUHOCTH MaHHbIX O TeXHW4eCKOM cCucTeMe) HM 93Tally cepHiiHoro 
TIpov“3BoAcTBa. BeposTHOcTs ycreliHoro Ucxoya Ip MCIIbITaHHM TeXHMYeCKNX CHCTeM IipeycTaBsIeHa depes3: 

— BCPOATHOCTH COOBITHA JIA JIIEMCHTAa CHCTEMBI; 

— 3HadeHHe JOBepUTeIBHOM BeposATHOCTH; 

— TpeOyeMbIii OObeM UcHbITAaHHi. 

C 9oTHx No3HyHi UccHeqOBaHbI HyeBad U asbTepHAaTHBHAad THMOTe3bI H COOTBETCTBYIOMNIHe HM TIpollexypbl KOHTPOIA 


HajJl@2KHOCTH. PaccmMoTpeHbi ABa TWOJIO#KCHHA. Tleppoe AONYCKaeT HCHOJIb3OBaHHe HyJ1eBort THHOTe3bI WOBepuA 
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H, = P2 Pe c ambTepHaTuBoit H =|P<P,} WIA NMOATBepxKyeHHA TpeOoBaHuit (P,, y) K MoKa3aTesO 
HaJje@2*KHOCTH OJHOrO Mapametpa pH soOnIX (P,, y). [pH stom AoctTarouHo oOfHOrO Oe30TKa3HOrO HCIIbITAHHA. 


Bropoe TIOJO7#KCHHE PaCCMaTPHBaeT NOCIICTOBATCJIBHYFO TEXHHYCCKYIO CHCTeMy C N He3aBHCHMbIMU SJIEMCHTaMH, 
KOTOPbIe€ HCHBITBIBAIOTCA OTICJIBHO OT CHCTCMBI IlI0 CXCMC Bepryms1u ASIA OTHOTO HapaMetpa. PaccMoTpuM TpeOoBaHHa 


K CHCTeME B BHC COBOKYNHOCTH BeM4HH (P,, Y) HW TpeOoBaHHa K jOOOMy ee sIeMeHTy (P,,, y). OHH coBnayator, 


eCJI TWIaHupyeMbiii MCXOJ, MCIbITaHHM COOTBCTCTBYe€T CJIYdaiM BbINOJIHCHHA COOTHOMICHHA P= lim iP, =P 
> 1sis<N a 


ae 
a HyJIeBad alIbTepHaTMBHad THMOTe3a BbIOUpaeTcA U3 TEOPHH MpOBepKH CTATHCTH4eCKHX FuMOTEeS. 

O6cystcoenue u 3aknio“enua. CTpatTeruto IKCIePHMCHTaIbHOM OTpaOoTKH CleAyeT peau30BaTb B Ba STAI: MOMCK H 
MOATBepKAeHHe HaexKHOCTH 3IEMeCHTOB CepHei Oe30TKa3HbIX HCIbITaHHH. B 9TOM cilyyae TaHHpyembili oObeM 
WCIbITaHHH + KaKAOrO 9ICMeCHTa OlpeyeteTcA C Yy4eTOM JOBeEPHTeIbHOM BePOATHOCTH, HWKHeM TpaHHUbl 
J{OBCPHTeIbHOTO HHTepBasla UH TpeOOBaHHit K NOKa3aTeAIM HajlexKHOCTH OJHOTO MapaMeTpa TeXHM4YeCKOM CHCTeMBI. 
Ecam JONycTHMO VCHONb30BaHHe HyeBOH THMOTe3bI AOBePHA, WIA MOATBepKCHHA TpeOoBaHHi K MOKa3aTesO 


Haq@2#KHOCTH JOCTATOYHO OJHOTO Oe30TKa3HOTO HCIIbITaHHA. 


Kiuoueevie cioea: SKCHepHUMeCHTasIbHaAa oTpadotTka, WpoBepKa CTAaTHCTHYCCKHX THHOTC3, HaeoxKHOCTb TexXHH4ecKol 
CHCTeCMbI, HyJIeBadt THMOTe3a, ajIbTepHaTHBHaA THMOTe3a, THHOTe3a HeAOBepHA, THMOTe3a AOBCpHA, AOBCpHTeCJIbHaA 
BepOATHOCTh, o0beM Oe30TKAa3HBIX MCHbITaHHH, MOJICJIb MCHbITaHHH OMHOMHAaJIbHOrO TUIa, CXeMa Bepuysuin, 


ypaBHenue Knonnepa — IIupcona, teopema A. J. Conosbezsa u P. A. Mupxoro. 


BaarogxapHocrn. ABTOPBI BbIparKaroT OnaroyapHocTh pelleH3eHTaM, UbA KPHTH4CCKadA OUCHKa pe ACTaBJICHHbIX MaTe- 
pHasIOB HW BbICKAa3aHHble UpeWIOKCHHA TO UX YCOBepMIeCHCTBOBaHHtO cmocoOcTBOBaIH 3HAYHTCJIBHOMY ITIOBbIMICHHIO 


KaudecTBa HacTosilei CTaTbH. 
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Introduction. Rational methods of validating the specified reliability levels are of current concern for experimental 
testing of a complex technical system when a decision is made on the possibility of testing it as part of a larger structure 
or on the completion of experimental development and the start of series production. The same tasks arise during series 
production, if it is required: 

— to assess the readiness of the enterprise to produce series products based on the test data of the pilot batch; 

— to make a conclusion about the compliance of the products with the requirements of technical documentation, 
taking into account the operating data. 

The study objective was to obtain an acceptable solution for planning and reducing the scope of tests using methods 
of interval estimation of reliability indices of sequential technical systems. To achieve the stated goal, it was required to 
determine whether hypothesis H, was accepted or rejected. 

Materials and Methods. It is reasonable to formulate the task of validating the requirements in terms of the theory 
of statistical hypothesis testing [1—4]. Let P be the reliability of the technical system, P7 — some fixed (required) level 


for P. Prior to testing about P, three initial assumptions can be made: P = P,, P < P,, P > Pr. 
Each of them is called a null hypothesis if it is written as: 


Het =P). B= iP oP.) =P Si 


Set H,= P = Pp} contains only one element, therefore, hypothesis H, = iP = Pt is called simple. 
Hypotheses of the form H, = iP < Pp} and H, = {P > Pr are called complex. Along with the null hypothesis 


expressing a pre-formulated point of view, an alternative hypothesis H is specified expressing the opposite statement 
A, (A, OH #1). We use the conceptual apparatus of the theory of information [1], probability and statistics, 
applicable to solving such problems. Consider two aggregates of sets H, and H: 

ASAP SP SP Se Pa (1) 
B= {P 22;) f= iP <P (2) 
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Hypothesis H, in (1) will be called rigid, or the distrust hypothesis. Indeed, in case (1), initially (before the test), we 
proceed from a position of distrust of the quality level of the system. Reliability index P is assumed to be no higher than 


a certain fixed level P’,,. Hypothesis H, in (2) will be called the confidence hypothesis, since in this case, it is initially 
assumed that reliability index P is not less than some fixed value Pr. 

The meaning of values P’, and Pr is different. In (1), P’, — such a rejected value that at P< P’,, the system is 
considered unacceptable. In (2), P; — such a value that at P = P,, the system is considered acceptable for use. 
Obviously, P, > P’,. 

Research Results. Thus, it is required to determine whether hypothesis H, is accepted or rejected. In the theory of 
statistical hypotheses, a critical area is constructed for this purpose based on the test results. It is described by some 
inequality. Moreover, the null hypothesis (due to the initial confidence in it) is adhered to as long as it is reasonable 
from the point of view of the accepted level of significance a. Therefore, as is already clear that the reliability control 


procedure in case (1) will be significantly different compared to case (2). 
Indeed, we will further make sure that to reject hypothesis H, in (1) and accept hypothesis H = {P > P.) of 
meeting the requirement for reliability indices, a critical area (or condition) should be used 
P>P*,, (3) 
where P — the lower bound of the confidence interval for P at the value of the confidence probability y = 1 — a; 
P’,, — the lower bound of the rejected interval for P at the value of confidence probability y = 1 — a. 


In case (2), the condition should be used to accept hypothesis H, about the compliance of the value of parameter P 


to the requirement 
P>P,, (4) 
where P — the upper bound of the confidence interval for P at the value of the confidence probability y = 1 — a. 
In (3) and (4), the requirement for the reliability index of one parameter P is understood as a set of values (P’,, Y) 
or (P,, y), given before testing. 


Let one successful test be carried out under the conditions of the Bernoulli scheme. Then, using the Clopper-Pearson 
relations, we find the lower and upper bounds of one parameter with the value, for example, y = 0.95: 


P=(1-y)'=1—y = 0.05; P=1. 


Here, even for very moderate values P’, € [0.05; 0.95] , condition (3) is not fulfilled, while (4) is fulfilled at any P;. 


Let us show the validity of the accepted position. 

First_position. If it is permissible to use the null confidence hypothesis H, = {P 2 Prt with alternative 
H = {P < Py , then one fail-safe test is sufficient to confirm the requirements (P,, y) for the reliability index of 
one parameter for any (P,, y). 

If the initial hypothesis H, is the hypothesis of distrust from (1), then a significantly larger number of tests are 
needed. Thus, for m = 0, we get n= log (1 = y)/logP, >>1. This is quite fair, because, when testing hypotheses, they 
initially proceed from the validity of the null hypothesis H,. 

At the stage of experimental development, there are no sufficiently complete data, therefore, it is reasonable to use 
control rule (3). At the stage of series production, one can proceed from the confidence hypothesis and use a 
significantly easier control rule (4). This is acceptable if, according to the experimental testing, condition (3) was 
fulfilled. 


Consider a system consisting of N independent elements connected in series, which can be tested separately. Then, 


the probability of a successful outcome when testing technical systems: 


P={IP. (5) 
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Here, P; — probability of the same event for the i-th element. The requirements for value P are specified in the form of 


a set of values (P,,y). It is required to plan a procedure for monitoring the reliability of one parameter for each 


element of the system, i.e., to specify Vi e[l,n] a pair (P;,, y). 
N 
Due to the multiplication of P; in formula (5), ratio [[4: =P must be fulfilled. Besides, y, = y . 


As a result, the required scope of tests n; of each element increases dramatically, and even with fail-safe results of all 
tests, it becomes unacceptable. At P; = 0.9 and y = 0.95, N= 100 and m=0, Vi= 1,N: 


P,, ~ P,'” = 0.999, n,, =log(1 — y)/logP,, ~ 3000. 
This method of planning is logically contradicted by inequality n,, >n,, following from P,; > P, when m; = 0. It 
is clear that with fail-safe outcomes, the required scope of tests n,; of i-th element, conducted separately from the 


system, should be equal to the required scope of tests of system n,. To avoid this contradiction, the theorems of 
A.D. Solovyov and R.A. Mirny should be used [5—7]. Thus, when m=0, Vi= LN: 


<i /n 
P=min:P, =f (n, 0,7) = (1-y)". (6) 
Here, P — the lower bound of the confidence interval for the reliability index of a technical system by one parameter, at 
value y of the confidence probability; P; — the value of the lower bound of the confidence interval for the reliability 
index of the i-th element of the system with the same confidence probability; » — minimum number of tests of system 
elements; f(n,0,y) — the root of the Clopper-Pearson equation: 


m 


1-y=)>) (",) P’*q' = B(n, P, m). (7) 
k=0 
According to [8-12]: 
f(nng.y) <P < f(a, [ng],y). (8) 


aS 


Here, q =1-P;P= (1 m, /n,); n= min nj 3 [ng] — integral part of the product nq: f(n.nq,y) — root 
of equation J,(n, P,ng +1) =1-y. 
From (8), it follows: 
P=min:P,=Pm, (9) 


lsi<N ~~ 
where P ,, — minimum of P; at the value of confidence probability y. 
P,=min:P,> P.S(P,2 Pp) OP, 2 P,)...A(Py 2 Pr). 


m 2 
1si<N 


This is true not only for case (1), when m=0, Vi= 1,N, but also for case (2), i.e., for the outcome 


n= (N,N, ....Ny), m= (mM, O, O, ..., O) of the tests, where n and m — the vector of tests and the vector of failures, 
if n =n. 
At this, only one element that has been tested a minimum number of times fails. Indeed, in this case, ng =m, —an 


integer. Calculations allowed us to establish that (9) is also approximately performed at the outcome of tests n, m, Le., 


in case (3), if for pair (n,,m,), min :P, =P.,, is possible. 


In all the cases mentioned (9), the lower bounds are not multiplied, and the system degenerates into one weakest 
element. This provides validating the following position. 

Second position. Consider a sequential system with N independent elements that are tested separately from the 
system according to the Bernoulli scheme for one parameter. The requirements specified for the system in the form of a 
set of values (P,, y), and the requirements for any of its elements (P,,, y;) coincide if the planned outcome of the 
tests corresponds to the mentioned cases of fulfillment of ratio (9), and the null alternative hypothesis is selected based 
on (1) and (2). 

Consequence. In case of (3), execution of (9) — the planned scope of fail-safe tests (V—1) of elements, it is 
determined from: 

n,; 2 N= log (1 —y) / logP,. (10) 
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The volume of failures of the conditionally first element at m, is from the ratio: 
P.=f(m,m,7) =P. (11) 
Proof (11) is based on the fact that the condition P = P,, = P, is fulfilled if P,, =P, = P, and P, <Vie[2,N]. 
The latter relation is satisfied if (10) is satisfied, because: 
120, = =p oP. 


In all the cases considered, it was assumed that there was no information about P before the tests, except for the 


obvious fact P e[0, il. However, it may be known that P = P,,, where Py=0. Hence, P = Pe [ Pi, 1] . Value Py 


can be found from test data or calculations at the time of planning reliability tests. There is no method for determining 
Py yet, and its development is the task of future research. But if value Py is known, according to the full probability 


formula, you can find: 


P =P+ qgP. 


From here: 
PaPor jit 2), P= PoP oP). (12) 


The latter relation is fulfilled due to monotonicity of dependence P = (P —P,,) inP: 


Taking into account (12), ratio (2) will take the form: 


P, +0 +P,)f(nnqy) <P <P, + 0 -P,)f(aingly - (13) 
Let the condition for making a decision on the compliance of the technical system with the requirements (Pr y) 


still be (3), where the lower bound of the confidence interval is determined from (13), taking into account 


P= P € [ Pi. 1| . Then, from the ratio: 


P2P, (14) 
we find the planned scope of trouble-free tests by one parameter for each of N elements: 
n, =n, =log(1 = y) log(P, —P,) / A -P,). C5) 
Value n’y decreases in Py. It means, no (10) at Py = 0 and n’y = O at Py = Pr. 


N 
Example. The requirements for the reliability indices P= []F of the system are specified for one parameter in the 


form of a set of values (P7= 0.90; y = 0.95). Number of elements of the technical system is N= 100. According to 
available data, P; > Py = 0.70. It is required to find the planned scope of tests for each of N elements, if the fulfillment 
of reliability requirements is checked by condition (14). From (15), we find: 

n; =Nn’o = log (0.05) / log (0.90 — 0.70) / (1 — 0.70) = 7. 

Note that at Py, = 0n;>n’y = 29. 

Ratios (10) and (15) make it possible to plan the required scope of testing of the i-th element of the technical system 
with a certain sequence of experimental development of the system. The whole process of experimental development is 
divided conditionally into two periods: the search and validation of reliability requirements for a decision on the 
transition to the next stage of testing or on the acceptance of a technical system for series production. In the first period, 
improvements are possible, and it is reasonable to use models with a variable probability P of a successful outcome of 
the system test. 

The data obtained in the first period can be used to calculate value Py. 

In the second period, we deal with an established version of the design of the technical system and technological 
process. This makes it possible to use the binomial type test models discussed above with constant probability P. 

Let the first period of developing N elements of the technical system be completed, then, the question is raised about 
validating the requirements for the reliability index of the system by one parameter. It is reasonable to validate 
reliability if a positive decision is made only in case of a fail-safe outcome of the last series of tests for each of N 
elements. This strategy is convenient because it is based on the minimum possible number of tests of elements of the 


technical system and provides simple analytical solutions (10) and (15). 
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In general, it makes sense to investigate a strategy that allows for failures of elements during testing and is based on 
optimization of some objective function. But here, we restrict ourselves to considering only the mentioned strategy with 
fail-safe final series. 

Discussion and Conclusions. The results of scientific research allowed us to formulate the following conclusions. 

1. Even with a large number of N elements of the system, it is possible to plan the scope of their tests. In this case, 
the methods of interval estimation of reliability indices of sequential technical systems provide obtaining an acceptable 
solution, but only for one parameter. 

2. The strategy of experimental development of technical systems is closely related to the method of validating the 
reliability of elements. The rational strategy of experimental development provides for confirmation of the reliability of 
the elements after the search period through a final series of fail-safe tests. In this case, the planned scope of tests of 
each of N elements does not depend on WN and is determined by ratio (15), which includes the requirements (P7, y) for 
the reliability indices of one parameter of the technical system as a whole and Py. The scope of tests obtained by (15) 
for each element of the technical system, for any number of them, is small if moderate requirements (P; = 0.80 ...0.95; 
y =0.90 ... 0.95) are specified for a system of N elements, but only for one parameter. At the same time, the scope 
decreases with increasing value Py. 

3. In series production, when testing upgraded technical systems, it is possible to use a control method with null and 
alternative hypothesis change. If the use of the null confidence hypothesis is acceptable, then one fail-safe test is 


sufficient to validate the requirements for the reliability index. 
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3aABNEHHbIU KAO Coaemopoe 

0.10. Llapes — dopmupopaHve OCHOBHOM KOHIICHIMH, Welw HW 3afadH UccieqoBaHHA, WpoBeyeHue pacuerTos, 
HMOZrOTOBKa TekcTa, dopMymHpoBaHve BpEIBO0B. 1O.A. Tapes — Hay4HOe pyKOBOJCTBO, aHallu3 pe3yIbTaTOB 
MCCJIeOBaHHH, WopaOoTKa TeKcTa, KOPpeKTUPOBKa BEIBOLOB. 


Tlocrynuia B pexakynt 09.01.2023. 
Tlocrynu.ia nocae penensuposanna 01.02.2023. 
I[puusta k nyOsnKkaynn 06.02.2023. 


Konudauxm unmepecoe 
ABTOPBI 3aABJIAIOT OO OTCYTCTBHHM KOH@JINKTAa HHTEPecos. 


Bce aemopbl npOYUmMAaIU U odoépunu OKOHYAMEbHbIU 6apuaHm PyKonucu. 
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